Filed by: archaeopteryx [at] coole-files.de
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=355034571&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Nxji8OB9SiCgr6hqdfPLXA/runs/0/artifacts/public/logs/live_backing.log

Since bug 1734262 landed, there are 8-11 instances of the following error in the log of telemetry tests. This makes it more difficult to identify the real issue if these tests actually fail.

[task 2021-10-16T19:34:35.432Z] 19:34:35     INFO -  *** You are running in headless mode.
[task 2021-10-16T19:34:35.440Z] 19:34:35     INFO -  [2021-10-16T19:34:35Z ERROR xulstore::persist] removeDocument error: unavailable
[task 2021-10-16T19:34:35.547Z] 19:34:35     INFO -  Missing chrome or resource URL: resource:///modules/backgroundtasks/BackgroundTask_pingsender.jsm
[task 2021-10-16T19:34:35.564Z] 19:34:35     INFO -  console.log: "pingsender: sending /builds/worker/workspace/build/tmpss3u9kww.mozrunner/saved-telemetry-pings/ca61b948-fa86-4cab-94b5-49e2de5a20ce to http://localhost:8000/pings/submit/telemetry/ca61b948-fa86-4cab-94b5-49e2de5a20ce/event/Firefox/95.0a1/default/20211016185857?v=4"
[task 2021-10-16T19:34:35.571Z] 19:34:35     INFO -  console.log: "pingsender: sending /builds/worker/workspace/build/tmpss3u9kww.mozrunner/saved-telemetry-pings/3a487364-cad3-4305-8488-429e79683a21 to http://localhost:8000/pings/submit/telemetry/3a487364-cad3-4305-8488-429e79683a21/main/Firefox/95.0a1/default/20211016185857?v=4"
[task 2021-10-16T19:34:35.603Z] 19:34:35     INFO -  console.log: "pingsender: read payload {\"type\":\"event\",\"id\":\"ca61b948-fa86-4cab-94b5-49e2de5a20ce\",\"creationDate\":\"2021-10-16T19:34:35.358Z\",\"version\":4,\"application\":{\"architecture\":\"x86-64\",\"buildId\":\"20211016185857\",\"name\":\"Firefox\",\"version\":\"95.0a1\",\"displayVersion\":\"95.0a1\",\"vendor\":\"Mozilla\",\"platformVersion\":\"95.0a1\",\"xpcomAbi\":\"x86_64-gcc3\",\"channel\":\"default\"},\"payload\":{\"reason\":\"shutdown\",\"processStartTimestamp\":1634412900000,\"sessionId\":\"bf40e535-167e-4735-8d93-9b273e84e3eb\",\"subsessionId\":\"e982e6f9-a98a-4c08-a432-6f9527487dcc\",\"lostEventsCount\":0,\"events\":{\"parent\":[[4227,\"upgrade_dialog\",\"trigger\",\"reason\",\"not-major\"]]}},\"clientId\":\"94eb5cc9-4d44-40af-a1ca-9c0cf96aeee3\",\"environment\":{\"build\":{\"applicationId\":\"{ec8030f7-c20a-464f-9b0e-13a3a9e97384}\",\"applicationName\":\"Firefox\",\"architecture\":\"x86-64\",\"buildId\":\"20211016185857\",\"version\":\"95.0a1\",\"vendor\":\"Mozilla\",\"displayVersion\":\"95.0a1\",\"platformVersion\":\"95.0a1\",\"xpcomAbi\":\"x86_64-gcc3\",\"updaterAvailable\":true},\"partner\":{\"distributionId\":null,\"distributionVersion\":null,\"partnerId\":null,\"distributor\":null,\"distributorChannel\":null,\"partnerNames\":[]},\"system\":{\"memoryMB\":7688,\"virtualMaxMB\":null,\"cpu\":{\"count\":2,\"cores\":1,\"vendor\":\"GenuineIntel\",\"family\":6,\"model\":85,\"stepping\":4,\"l2cacheKB\":1024,\"l3cacheKB\":33792,\"speedMHz\":0,\"extensions\":[\"hasMMX\",\"hasSSE\",\"hasSSE2\",\"hasSSE3\",\"hasSSSE3\",\"hasSSE4_1\",\"hasSSE4_2\",\"hasAVX\",\"hasAVX2\",\"hasAES\"]},\"os\":{\"name\":\"Linux\",\"version\":\"4.4.0-1014-aws\",\"locale\":\"en-US\"},\"hdd\":{\"profile\":{\"model\":null,\"revision\":null,\"type\":null},\"binary\":{\"model\":null,\"revision\":null,\"type\":null},\"system\":{\"model\":null,\"revision\":null,\"type\":null}},\"gfx\":{\"D2DEnabled\":null,\"DWriteEnabled\":null,\"ContentBackend\":\"Skia\",\"Headless\":false,\"EmbeddedInFirefoxReality\":null,\"adapters\":[{\"description\":\"llvmpipe (LLVM 10.0.0, 256 bits)\",\"vendorID\":\"VMware, Inc.\",\"deviceID\":\"llvmpipe (LLVM 10.0.0, 256 bits)\",\"subsysID\":null,\"RAM\":0,\"driver\":null,\"driverVendor\":\"mesa/llvmpipe\",\"driverVersion\":\"20.0.8.0\",\"driverDate\":null,\"GPUActive\":true},{\"description\":null,\"vendorID\":\"0x1d0f\",\"deviceID\":\"0x1111\",\"subsysID\":null,\"RAM\":null,\"driver\":null,\"driverVendor\":null,\"driverVersion\":null,\"driverDate\":null,\"GPUActive\":false}],\"monitors\":[{\"screenWidth\":1600,\"screenHeight\":1200}],\"features\":{\"compositor\":\"webrender\",\"hwCompositing\":{\"status\":\"available\"},\"gpuProcess\":{\"status\":\"unused\"},\"wrQualified\":{\"status\":\"blocklisted:FEATURE_FAILURE_SOFTWARE_GL\"},\"webrender\":{\"status\":\"force_enabled\"},\"wrCompositor\":{\"status\":\"blocklisted:FEATURE_FAILURE_WEBRENDER_COMPOSITOR_DISABLED\"},\"wrSoftware\":{\"status\":\"available\"},\"openglCompositing\":{\"status\":\"blocklisted:FEATURE_FAILURE_SOFTWARE_GL\"},\"omtp\":{\"status\":\"unused\"}}},\"appleModelId\":null,\"hasWinPackageId\":null},\"settings\":{\"blocklistEnabled\":true,\"e10sEnabled\":true,\"e10sMultiProcesses\":8,\"fissionEnabled\":false,\"telemetryEnabled\":false,\"locale\":\"en-US\",\"intl\":{\"requestedLocales\":[\"en-US\"],\"availableLocales\":[\"en-US\"],\"appLocales\":[\"en-US\"],\"systemLocales\":[\"en-US\"],\"regionalPrefsLocales\":[\"en-US\"],\"acceptLanguages\":[\"en-US\",\"en\"]},\"update\":{\"channel\":\"default\",\"enabled\":true,\"autoDownload\":false,\"background\":true},\"userPrefs\":{\"app.shield.optoutstudies.enabled\":false,\"browser.newtabpage.enabled\":false,\"browser.shell.checkDefaultBrowser\":false,\"browser.search.widget.inNavBar\":false,\"browser.startup.page\":0,\"browser.urlbar.suggest.quicksuggest\":false,\"browser.urlbar.suggest.quicksuggest.sponsored\":false,\"browser.urlbar.suggest.searches\":false,\"dom.max_script_run_time\":0,\"extensions.autoDisableScopes\":0,\"extensions.enabledScopes\":5,\"extensions.update.enabled\":false,\"privacy.trackingprotection.enabled\":false,\"signon.rememberSignons\":false,\"widget.content.allow-gtk-dark-theme\":false,\"widget.content.gtk-high-contrast.enabled\":true},\"sandbox\":{\"effectiveContentProcessLevel\":4,\"contentWin32kLockdownState\":3},\"addonCompatibilityCheckEnabled\":true,\"isDefaultBrowser\":false,\"defaultSearchEngine\":\"google-b-d\",\"defaultSearchEngineData\":{\"loadPath\":\"[other]addEngineWithDetails:google@search.mozilla.org\",\"name\":\"Google\",\"origin\":\"default\",\"submissionURL\":\"https://www.google.com/search?client=firefox-b-d&q=\"}},\"profile\":{\"creationDate\":18916,\"firstUseDate\":18916},\"addons\":{\"activeAddons\":{\"doh-rollout@mozilla.org\":{\"version\":\"2.0.0\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"This used to be a Mozilla add-on that supported the roll-out of DoH, but now only exists as a stub t\",\"name\":\"DoH Roll-Out\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"formautofill@mozilla.org\":{\"version\":\"1.0.1\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":null,\"name\":\"Form Autofill\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"pictureinpicture@mozilla.org\":{\"version\":\"1.0.0\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"Fixes for web compatibility with Picture-in-Picture\",\"name\":\"Picture-In-Picture\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"proxy-failover@mozilla.com\":{\"version\":\"1.0.2\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"Direct Failover for system requests.\",\"name\":\"Proxy Failover\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"screenshots@mozilla.org\":{\"version\":\"39.0.1\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"Take clips and screenshots from the Web and save them temporarily or permanently.\",\"name\":\"Firefox Screenshots\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"webcompat-reporter@mozilla.org\":{\"version\":\"1.4.2\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"Report site compatibility issues on webcompat.com\",\"name\":\"WebCompat Reporter\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"webcompat@mozilla.org\":{\"version\":\"27.2.0\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"Urgent post-release fixes for web compatibility.\",\"name\":\"Web Compatibility Interventions\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"67158ec668d41f34b18c9548c4ce393f5f9ae2f2@temporary-addon\":{\"version\":\"1.0\",\"scope\":16,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":false,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"Extension to be installed in telemetry-tests-client tests.\",\"name\":\"helloworld\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916,\"signedState\":-1}},\"theme\":{\"id\":\"default-theme@mozilla.org\",\"blocklisted\":false,\"description\":\"Follow the operating system setting for buttons, menus, and windows.\",\"name\":\"System theme \u2014 auto\",\"userDisabled\":false,\"appDisabled\":false,\"version\":\"1.3\",\"scope\":4,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916,\"updateDay\":18916},\"activeGMPlugins\":{\"gmp-gmpopenh264\":{\"version\":null,\"userDisabled\":false,\"applyBackgroundUpdates\":1}}}}}"
[task 2021-10-16T19:34:35.705Z] 19:34:35     INFO -  console.log: "pingsender: read payload {\"type\":\"main\",\"id\":\"3a487364-cad3-4305-8488-429e79683a21\",\"creationDate\":\"2021-10-16T19:34:35.371Z\",\"version\":4,\"application\":{\"architecture\":\"x86-64\",\"buildId\":\"20211016185857\",\"name\":\"Firefox\",\"version\":\"95.0a1\",\"displayVersion\":\"95.0a1\",\"vendor\":\"Mozilla\",\"platformVersion\":\"95.0a1\",\"xpcomAbi\":\"x86_64-gcc3\",\"channel\":\"default\"},\"payload\":{\"ver\":4,\"simpleMeasurements\":{\"totalTime\":5,\"start\":10,\"main\":25,\"selectProfile\":87,\"afterProfileLocked\":88,\"startupCrashDetectionBegin\":1331,\"startupCrashDetectionEnd\":4987,\"firstPaint\":1521,\"firstPaint2\":1521,\"sessionRestoreInit\":1380,\"sessionRestored\":3532,\"createTopLevelWindow\":133,\"quitApplication\":5011,\"profileBeforeChange\":5203,\"blankWindowShown\":1329,\"AMI_startup_begin\":1339,\"XPI_startup_begin\":1342,\"XPI_bootstrap_addons_begin\":1346,\"XPI_bootstrap_addons_end\":1359,\"XPI_startup_end\":1359,\"AMI_startup_end\":1360,\"XPI_finalUIStartup\":1379,\"sessionRestoreInitialized\":1381,\"delayedStartupStarted\":3449,\"delayedStartupFinished\":3496,\"startupInterrupted\":0,\"debuggerAttached\":0,\"activeTicks\":0},\"processes\":{\"parent\":{\"scalars\":{\"browser.engagement.max_concurrent_tab_count\":1,\"telemetry.data_upload_optin\":true,\"browser.engagement.session_time_including_suspend\":5210,\"browser.engagement.session_time_excluding_suspend\":5210,\"browser.engagement.max_concurrent_window_count\":1},\"keyedScalars\":{}},\"content\":{\"histograms\":{\"GC_PRETENURE_COUNT_2\":{\"bucket_count\":20,\"histogram_type\":0,\"sum\":0,\"range\":[1,100],\"values\":{\"0\":1,\"1\":0}},\"DESERIALIZE_BYTES\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":89272,\"range\":[16,2147483646],\"values\":{\"0\":0,\"16\":7,\"23\":32,\"41\":2,\"61\":22,\"74\":21,\"90\":4,\"160\":18,\"194\":2,\"235\":21,\"344\":3,\"416\":3,\"609\":32,\"737\":11,\"892\":24,\"2318\":2,\"2805\":3,\"4109\":1,\"4973\":0}},\"DESERIALIZE_ITEMS\":{\"bucket_count\":50,\"histogram_type\":0,\"sum\":3397,\"range\":[1,2147483646],\"values\":{\"0\":0,\"1\":43,\"3\":84,\"5\":1,\"8\":1,\"12\":2,\"19\":31,\"30\":38,\"47\":2,\"73\":2,\"113\":4,\"176\":0}},\"DESERIALIZE_US\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":2496,\"range\":[1,150000000],\"values\":{\"0\":1,\"1\":21,\"2\":15,\"3\":12,\"4\":22,\"5\":22,\"6\":16,\"7\":8,\"8\":3,\"10\":6,\"12\":11,\"14\":14,\"17\":15,\"20\":17,\"24\":12,\"29\":4,\"35\":3,\"50\":3,\"60\":1,\"72\":1,\"126\":1,\"151\":0}},\"GHOST_WINDOWS\":{\"bucket_count\":32,\"histogram_type\":0,\"sum\":0,\"range\":[1,128],\"values\":{\"0\":1,\"1\":0}},\"SCRIPT_PRELOADER_REQUESTS\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":52,\"range\":[1,50],\"values\":{\"0\":14,\"2\":26,\"3\":0}},\"SCRIPT_PRELOADER_WAIT_TIME\":{\"bucket_count\":20,\"histogram_type\":0,\"sum\":0,\"range\":[1,10000],\"values\":{\"0\":8,\"1\":0}},\"MASTER_PASSWORD_ENABLED\":{\"bucket_count\":3,\"histogram_type\":3,\"sum\":0,\"range\":[1,2],\"values\":{\"0\":1,\"1\":0}},\"CONTENT_DOCUMENTS_DESTROYED\":{\"bucket_count\":3,\"histogram_type\":4,\"sum\":2,\"range\":[1,2],\"values\":{\"0\":2,\"1\":0}},\"CONTENT_PAINT_TIME\":{\"bucket_count\":50,\"histogram_type\":0,\"sum\":0,\"range\":[1,1000],\"values\":{\"0\":3,\"1\":0}},\"TIME_TO_NON_BLANK_PAINT_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":140,\"range\":[1,100000],\"values\":{\"125\":0,\"139\":1,\"154\":0}},\"TIME_TO_DOM_LOADING_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":112,\"range\":[1,50000],\"values\":{\"98\":0,\"108\":1,\"119\":0}},\"TIME_TO_DOM_INTERACTIVE_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":122,\"range\":[1,50000],\"values\":{\"108\":0,\"119\":1,\"131\":0}},\"TIME_TO_DOM_CONTENT_LOADED_START_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":123,\"range\":[1,50000],\"values\":{\"108\":0,\"119\":1,\"131\":0}},\"TIME_TO_DOM_CONTENT_LOADED_END_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":127,\"range\":[1,50000],\"values\":{\"108\":0,\"119\":1,\"131\":0}},\"TIME_TO_DOM_COMPLETE_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":137,\"range\":[1,50000],\"values\":{\"119\":0,\"131\":1,\"144\":0}},\"TIME_TO_LOAD_EVENT_START_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":137,\"range\":[1,50000],\"values\":{\"119\":0,\"131\":1,\"144\":0}},\"TIME_TO_LOAD_EVENT_END_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":138,\"range\":[1,50000],\"values\":{\"119\":0,\"131\":1,\"144\":0}},\"APZ_ZOOM_ACTIVITY\":{\"bucket_count\":3,\"histogram_type\":2,\"sum\":0,\"range\":[1,2],\"values\":{\"0\":1,\"1\":0}}},\"keyedHistograms\":{},\"scalars\":{\"networking.http3_enabled\":true,\"telemetry.discarded.scalar_actions\":0,\"telemetry.discarded.keyed_scalar_actions\":0,\"telemetry.discarded.keyed_accumulations\":0,\"telemetry.discarded.child_events\":0,\"telemetry.discarded.accumulations\":0,\"script.preloader.mainthread_recompile\":8},\"keyedScalars\":{}},\"extension\":{\"histograms\":{\"GC_PRETENURE_COUNT_2\":{\"bucket_count\":20,\"histogram_type\":0,\"sum\":1,\"range\":[1,100],\"values\":{\"0\":3,\"1\":1,\"2\":0}},\"DESERIALIZE_BYTES\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":1010296,\"range\":[16,2147483646],\"values\":{\"0\":0,\"16\":86,\"23\":18,\"34\":67,\"41\":1,\"50\":15,\"61\":8,\"74\":7,\"90\":2,\"109\":8,\"160\":9,\"194\":21,\"235\":7,\"284\":4,\"344\":63,\"416\":14,\"503\":2,\"609\":16,\"737\":11,\"892\":13,\"1080\":3,\"1307\":5,\"1582\":10,\"1915\":5,\"2318\":2,\"2805\":8,\"3395\":5,\"4109\":12,\"4973\":6,\"6019\":4,\"7284\":6,\"8815\":6,\"10668\":5,\"12911\":1,\"15625\":3,\"27698\":1,\"40569\":2,\"330972\":1,\"400557\":0}},\"DESERIALIZE_ITEMS\":{\"bucket_count\":50,\"histogram_type\":0,\"sum\":31042,\"range\":[1,2147483646],\"values\":{\"0\":0,\"1\":110,\"3\":111,\"5\":9,\"8\":17,\"12\":88,\"19\":20,\"30\":23,\"47\":10,\"73\":12,\"113\":13,\"176\":13,\"274\":10,\"426\":10,\"662\":7,\"1029\":2,\"1599\":1,\"2485\":1,\"3862\":0}},\"DESERIALIZE_US\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":21048,\"range\":[1,150000000],\"values\":{\"0\":19,\"1\":145,\"2\":14,\"3\":18,\"4\":15,\"5\":9,\"6\":11,\"7\":10,\"8\":10,\"10\":12,\"12\":32,\"14\":27,\"17\":24,\"20\":18,\"24\":12,\"29\":11,\"35\":9,\"42\":5,\"50\":7,\"60\":9,\"72\":4,\"87\":5,\"105\":6,\"126\":4,\"151\":5,\"182\":3,\"219\":2,\"316\":2,\"380\":1,\"457\":2,\"549\":1,\"793\":2,\"1992\":1,\"2879\":2,\"3461\":0}},\"GHOST_WINDOWS\":{\"bucket_count\":32,\"histogram_type\":0,\"sum\":0,\"range\":[1,128],\"values\":{\"0\":1,\"1\":0}},\"SCRIPT_PRELOADER_REQUESTS\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":46,\"range\":[1,50],\"values\":{\"0\":13,\"2\":23,\"3\":0}},\"SCRIPT_PRELOADER_WAIT_TIME\":{\"bucket_count\":20,\"histogram_type\":0,\"sum\":0,\"range\":[1,10000],\"values\":{\"0\":5,\"1\":0}},\"MASTER_PASSWORD_ENABLED\":{\"bucket_count\":3,\"histogram_type\":3,\"sum\":0,\"range\":[1,2],\"values\":{\"0\":1,\"1\":0}},\"QUERY_STRIPPING_COUNT\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":0,\"range\":[1,50],\"values\":{\"0\":5,\"1\":0}},\"CONTENT_DOCUMENTS_DESTROYED\":{\"bucket_count\":3,\"histogram_type\":4,\"sum\":10,\"range\":[1,2],\"values\":{\"0\":10,\"1\":0}},\"JS_PAGELOAD_PARSE_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":4,\"range\":[1,10000],\"values\":{\"0\":2,\"1\":1,\"3\":1,\"4\":0}},\"CONTENT_PAINT_TIME\":{\"bucket_count\":50,\"histogram_type\":0,\"sum\":0,\"range\":[1,1000],\"values\":{\"0\":14,\"1\":0}},\"TIME_TO_DOM_LOADING_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":1487,\"range\":[1,50000],\"values\":{\"255\":0,\"281\":5,\"309\":0}},\"TIME_TO_DOM_INTERACTIVE_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":2609,\"range\":[1,50000],\"values\":{\"412\":0,\"454\":3,\"605\":2,\"666\":0}},\"TIME_TO_DOM_CONTENT_LOADED_START_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":2861,\"range\":[1,50000],\"values\":{\"412\":0,\"454\":3,\"666\":2,\"733\":0}},\"TIME_TO_DOM_CONTENT_LOADED_END_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":2865,\"range\":[1,50000],\"values\":{\"412\":0,\"454\":3,\"666\":2,\"733\":0}},\"TIME_TO_DOM_COMPLETE_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":3070,\"range\":[1,50000],\"values\":{\"412\":0,\"454\":2,\"666\":3,\"733\":0}},\"TIME_TO_LOAD_EVENT_START_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":3070,\"range\":[1,50000],\"values\":{\"412\":0,\"454\":2,\"666\":3,\"733\":0}},\"TIME_TO_LOAD_EVENT_END_MS\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":3070,\"range\":[1,50000],\"values\":{\"412\":0,\"454\":2,\"666\":3,\"733\":0}},\"REL_PRELOAD_MISS_RATIO\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":0,\"range\":[1,50],\"values\":{\"0\":19,\"1\":0}},\"USE_COUNTER2_CONSOLE_DEBUG_DOCUMENT\":{\"bucket_count\":3,\"histogram_type\":2,\"sum\":1,\"range\":[1,2],\"values\":{\"0\":0,\"1\":1,\"2\":0}}},\"keyedHistograms\":{},\"scalars\":{\"networking.http3_enabled\":true,\"telemetry.discarded.scalar_actions\":0,\"telemetry.discarded.keyed_scalar_actions\":0,\"telemetry.discarded.keyed_accumulations\":0,\"telemetry.discarded.child_events\":0,\"telemetry.discarded.accumulations\":0,\"script.preloader.mainthread_recompile\":5},\"keyedScalars\":{}},\"dynamic\":{\"scalars\":{},\"keyedScalars\":{}},\"gpu\":{\"histograms\":{},\"keyedHistograms\":{},\"scalars\":{},\"keyedScalars\":{}},\"socket\":{\"histograms\":{},\"keyedHistograms\":{},\"scalars\":{},\"keyedScalars\":{}}},\"histograms\":{\"A11Y_INSTANTIATED_FLAG\":{\"bucket_count\":3,\"histogram_type\":3,\"sum\":0,\"range\":[1,2],\"values\":{\"0\":1,\"1\":0}},\"COMPOSITE_TIME\":{\"bucket_count\":50,\"histogram_type\":0,\"sum\":1021,\"range\":[1,1000],\"values\":{\"388\":0,\"437\":1,\"554\":1,\"623\":0}},\"DESERIALIZE_BYTES\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":170488,\"range\":[16,2147483646],\"values\":{\"0\":0,\"16\":15,\"41\":1,\"50\":1,\"61\":6,\"74\":7,\"90\":5,\"109\":2,\"160\":6,\"194\":1,\"235\":7,\"284\":1,\"344\":1,\"416\":2,\"609\":7,\"737\":3,\"892\":7,\"1080\":6,\"10668\":2,\"33521\":3,\"40569\":0}},\"DESERIALIZE_ITEMS\":{\"bucket_count\":50,\"histogram_type\":0,\"sum\":11079,\"range\":[1,2147483646],\"values\":{\"0\":0,\"1\":15,\"3\":29,\"5\":5,\"8\":1,\"12\":2,\"19\":10,\"30\":10,\"47\":6,\"426\":2,\"2485\":3,\"3862\":0}},\"DESERIALIZE_US\":{\"bucket_count\":100,\"histogram_type\":0,\"sum\":3595,\"range\":[1,150000000],\"values\":{\"0\":0,\"1\":11,\"2\":7,\"3\":4,\"4\":11,\"5\":8,\"6\":1,\"7\":3,\"8\":1,\"10\":3,\"12\":2,\"14\":7,\"17\":2,\"20\":5,\"24\":10,\"35\":1,\"50\":1,\"87\":1,\"151\":1,\"182\":1,\"660\":1,\"793\":2,\"953\":0}},\"HTTP_KBREAD_PER_CONN2\":{\"bucket_count\":50,\"histogram_type\":0,\"sum\":0,\"range\":[1,100000],\"values\":{\"0\":2,\"1\":0}},\"HTTP_CHANNEL_DISPOSITION\":{\"bucket_count\":17,\"histogram_type\":1,\"sum\":3,\"range\":[1,16],\"values\":{\"2\":0,\"3\":1,\"4\":0}},\"HTTP_CHANNEL_ONSTART_SUCCESS\":{\"bucket_count\":3,\"histogram_type\":2,\"sum\":0,\"range\":[1,2],\"values\":{\"0\":1,\"1\":0}},\"DNS_LOOKUP_METHOD2\":{\"bucket_count\":17,\"histogram_type\":1,\"sum\":2,\"range\":[1,16],\"values\":{\"0\":0,\"1\":2,\"2\":0}},\"STARTUP_CACHE_REQUESTS\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":24,\"range\":[1,50],\"values\":{\"0\":0,\"1\":2,\"2\":11,\"3\":0}},\"SCRIPT_PRELOADER_REQUESTS\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":26,\"range\":[1,50],\"values\":{\"1\":0,\"2\":13,\"3\":0}},\"URLCLASSIFIER_SHUTDOWN_TIME\":{\"bucket_count\":50,\"histogram_type\":0,\"sum\":0,\"range\":[1,60000],\"values\":{\"0\":1,\"1\":0}},\"MASTER_PASSWORD_ENABLED\":{\"bucket_count\":3,\"histogram_type\":3,\"sum\":0,\"range\":[1,2],\"values\":{\"0\":1,\"1\":0}},\"TOP_LEVEL_CONTENT_DOCUMENTS_DESTROYED\":{\"bucket_count\":3,\"histogram_type\":4,\"sum\":6,\"range\":[1,2],\"values\":{\"0\":6,\"1\":0}},\"CONTENT_FULL_PAINT_TIME\":{\"bucket_count\":50,\"histogram_type\":0,\"sum\":0,\"range\":[1,1000],\"values\":{\"0\":1,\"1\":0}},\"USE_COUNTER2_CONSOLE_DEBUG_PAGE\":{\"bucket_count\":3,\"histogram_type\":2,\"sum\":1,\"range\":[1,2],\"values\":{\"0\":0,\"1\":1,\"2\":0}}},\"keyedHistograms\":{\"HTTP_CHANNEL_DISPOSITION_UPGRADE\":{\"disabledWont\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":3,\"range\":[1,50],\"values\":{\"2\":0,\"3\":1,\"4\":0}}},\"HTTP3_CHANNEL_ONSTART_SUCCESS\":{\"no_http3\":{\"bucket_count\":3,\"histogram_type\":2,\"sum\":0,\"range\":[1,2],\"values\":{\"0\":1,\"1\":0}}},\"SQLITE_STORE_OPEN\":{\"ls-archive.sqlite\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":0,\"range\":[1,50],\"values\":{\"0\":1,\"1\":0}},\"webappsstore.sqlite\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":0,\"range\":[1,50],\"values\":{\"0\":1,\"1\":0}}},\"SQLITE_STORE_QUERY\":{\"cookies.sqlite\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":0,\"range\":[1,50],\"values\":{\"0\":2,\"1\":0}},\"1451318868ntouromlalnodry--epcr.sqlite\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":0,\"range\":[1,50],\"values\":{\"0\":1,\"1\":0}},\"1657114595AmcateirvtiSty.sqlite\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":0,\"range\":[1,50],\"values\":{\"0\":7,\"1\":0}},\"ls-archive.sqlite\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":0,\"range\":[1,50],\"values\":{\"0\":10,\"1\":0}},\"places.sqlite\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":0,\"range\":[1,50],\"values\":{\"0\":1,\"1\":0}},\"webappsstore.sqlite\":{\"bucket_count\":51,\"histogram_type\":5,\"sum\":0,\"range\":[1,50],\"values\":{\"0\":16,\"1\":0}}}},\"info\":{\"reason\":\"shutdown\",\"revision\":\"https://hg.mozilla.org/integration/autoland/rev/20bebe9b0129b66ac814330deb5bf7d1d8aabcdc\",\"timezoneOffset\":0,\"previousBuildId\":null,\"sessionId\":\"bf40e535-167e-4735-8d93-9b273e84e3eb\",\"subsessionId\":\"e982e6f9-a98a-4c08-a432-6f9527487dcc\",\"previousSessionId\":\"ea889660-732f-4fc3-a025-8753654267cc\",\"previousSubsessionId\":\"265c3672-5489-494b-a8f7-118eb5539317\",\"subsessionCounter\":2,\"profileSubsessionCounter\":2,\"sessionStartDate\":\"2021-10-16T19:00:00.0+00:00\",\"subsessionStartDate\":\"2021-10-16T19:00:00.0+00:00\",\"sessionLength\":5,\"subsessionLength\":0,\"addons\":\"doh-rollout%40mozilla.org:2.0.0,formautofill%40mozilla.org:1.0.1,pictureinpicture%40mozilla.org:1.0.0,proxy-failover%40mozilla.com:1.0.2,screenshots%40mozilla.org:39.0.1,webcompat-reporter%40mozilla.org:1.4.2,webcompat%40mozilla.org:27.2.0,default-theme%40mozilla.org:1.3,google%40search.mozilla.org:1.1,amazondotcom%40search.mozilla.org:1.3,wikipedia%40search.mozilla.org:1.1,bing%40search.mozilla.org:1.3,ddg%40search.mozilla.org:1.1\"}},\"clientId\":\"94eb5cc9-4d44-40af-a1ca-9c0cf96aeee3\",\"environment\":{\"build\":{\"applicationId\":\"{ec8030f7-c20a-464f-9b0e-13a3a9e97384}\",\"applicationName\":\"Firefox\",\"architecture\":\"x86-64\",\"buildId\":\"20211016185857\",\"version\":\"95.0a1\",\"vendor\":\"Mozilla\",\"displayVersion\":\"95.0a1\",\"platformVersion\":\"95.0a1\",\"xpcomAbi\":\"x86_64-gcc3\",\"updaterAvailable\":true},\"partner\":{\"distributionId\":null,\"distributionVersion\":null,\"partnerId\":null,\"distributor\":null,\"distributorChannel\":null,\"partnerNames\":[]},\"system\":{\"memoryMB\":7688,\"virtualMaxMB\":null,\"cpu\":{\"count\":2,\"cores\":1,\"vendor\":\"GenuineIntel\",\"family\":6,\"model\":85,\"stepping\":4,\"l2cacheKB\":1024,\"l3cacheKB\":33792,\"speedMHz\":0,\"extensions\":[\"hasMMX\",\"hasSSE\",\"hasSSE2\",\"hasSSE3\",\"hasSSSE3\",\"hasSSE4_1\",\"hasSSE4_2\",\"hasAVX\",\"hasAVX2\",\"hasAES\"]},\"os\":{\"name\":\"Linux\",\"version\":\"4.4.0-1014-aws\",\"locale\":\"en-US\"},\"hdd\":{\"profile\":{\"model\":null,\"revision\":null,\"type\":null},\"binary\":{\"model\":null,\"revision\":null,\"type\":null},\"system\":{\"model\":null,\"revision\":null,\"type\":null}},\"gfx\":{\"D2DEnabled\":null,\"DWriteEnabled\":null,\"ContentBackend\":\"Skia\",\"Headless\":false,\"EmbeddedInFirefoxReality\":null,\"adapters\":[{\"description\":\"llvmpipe (LLVM 10.0.0, 256 bits)\",\"vendorID\":\"VMware, Inc.\",\"deviceID\":\"llvmpipe (LLVM 10.0.0, 256 bits)\",\"subsysID\":null,\"RAM\":0,\"driver\":null,\"driverVendor\":\"mesa/llvmpipe\",\"driverVersion\":\"20.0.8.0\",\"driverDate\":null,\"GPUActive\":true},{\"description\":null,\"vendorID\":\"0x1d0f\",\"deviceID\":\"0x1111\",\"subsysID\":null,\"RAM\":null,\"driver\":null,\"driverVendor\":null,\"driverVersion\":null,\"driverDate\":null,\"GPUActive\":false}],\"monitors\":[{\"screenWidth\":1600,\"screenHeight\":1200}],\"features\":{\"compositor\":\"webrender\",\"hwCompositing\":{\"status\":\"available\"},\"gpuProcess\":{\"status\":\"unused\"},\"wrQualified\":{\"status\":\"blocklisted:FEATURE_FAILURE_SOFTWARE_GL\"},\"webrender\":{\"status\":\"force_enabled\"},\"wrCompositor\":{\"status\":\"blocklisted:FEATURE_FAILURE_WEBRENDER_COMPOSITOR_DISABLED\"},\"wrSoftware\":{\"status\":\"available\"},\"openglCompositing\":{\"status\":\"blocklisted:FEATURE_FAILURE_SOFTWARE_GL\"},\"omtp\":{\"status\":\"unused\"}}},\"appleModelId\":null,\"hasWinPackageId\":null},\"settings\":{\"blocklistEnabled\":true,\"e10sEnabled\":true,\"e10sMultiProcesses\":8,\"fissionEnabled\":false,\"telemetryEnabled\":false,\"locale\":\"en-US\",\"intl\":{\"requestedLocales\":[\"en-US\"],\"availableLocales\":[\"en-US\"],\"appLocales\":[\"en-US\"],\"systemLocales\":[\"en-US\"],\"regionalPrefsLocales\":[\"en-US\"],\"acceptLanguages\":[\"en-US\",\"en\"]},\"update\":{\"channel\":\"default\",\"enabled\":true,\"autoDownload\":false,\"background\":true},\"userPrefs\":{\"app.shield.optoutstudies.enabled\":false,\"browser.newtabpage.enabled\":false,\"browser.shell.checkDefaultBrowser\":false,\"browser.search.widget.inNavBar\":false,\"browser.startup.page\":0,\"browser.urlbar.suggest.quicksuggest\":false,\"browser.urlbar.suggest.quicksuggest.sponsored\":false,\"browser.urlbar.suggest.searches\":false,\"dom.max_script_run_time\":0,\"extensions.autoDisableScopes\":0,\"extensions.enabledScopes\":5,\"extensions.update.enabled\":false,\"privacy.trackingprotection.enabled\":false,\"signon.rememberSignons\":false,\"widget.content.allow-gtk-dark-theme\":false,\"widget.content.gtk-high-contrast.enabled\":true},\"sandbox\":{\"effectiveContentProcessLevel\":4,\"contentWin32kLockdownState\":3},\"addonCompatibilityCheckEnabled\":true,\"isDefaultBrowser\":false,\"defaultSearchEngine\":\"google-b-d\",\"defaultSearchEngineData\":{\"loadPath\":\"[other]addEngineWithDetails:google@search.mozilla.org\",\"name\":\"Google\",\"origin\":\"default\",\"submissionURL\":\"https://www.google.com/search?client=firefox-b-d&q=\"}},\"profile\":{\"creationDate\":18916,\"firstUseDate\":18916},\"addons\":{\"activeAddons\":{\"doh-rollout@mozilla.org\":{\"version\":\"2.0.0\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"This used to be a Mozilla add-on that supported the roll-out of DoH, but now only exists as a stub t\",\"name\":\"DoH Roll-Out\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"formautofill@mozilla.org\":{\"version\":\"1.0.1\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":null,\"name\":\"Form Autofill\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"pictureinpicture@mozilla.org\":{\"version\":\"1.0.0\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"Fixes for web compatibility with Picture-in-Picture\",\"name\":\"Picture-In-Picture\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"proxy-failover@mozilla.com\":{\"version\":\"1.0.2\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"Direct Failover for system requests.\",\"name\":\"Proxy Failover\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"screenshots@mozilla.org\":{\"version\":\"39.0.1\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"Take clips and screenshots from the Web and save them temporarily or permanently.\",\"name\":\"Firefox Screenshots\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"webcompat-reporter@mozilla.org\":{\"version\":\"1.4.2\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"Report site compatibility issues on webcompat.com\",\"name\":\"WebCompat Reporter\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"webcompat@mozilla.org\":{\"version\":\"27.2.0\",\"scope\":1,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":true,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"Urgent post-release fixes for web compatibility.\",\"name\":\"Web Compatibility Interventions\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916},\"67158ec668d41f34b18c9548c4ce393f5f9ae2f2@temporary-addon\":{\"version\":\"1.0\",\"scope\":16,\"type\":\"extension\",\"updateDay\":18916,\"isSystem\":false,\"isWebExtension\":true,\"multiprocessCompatible\":true,\"blocklisted\":false,\"description\":\"Extension to be installed in telemetry-tests-client tests.\",\"name\":\"helloworld\",\"userDisabled\":false,\"appDisabled\":false,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916,\"signedState\":-1}},\"theme\":{\"id\":\"default-theme@mozilla.org\",\"blocklisted\":false,\"description\":\"Follow the operating system setting for buttons, menus, and windows.\",\"name\":\"System theme \u2014 auto\",\"userDisabled\":false,\"appDisabled\":false,\"version\":\"1.3\",\"scope\":4,\"foreignInstall\":false,\"hasBinaryComponents\":false,\"installDay\":18916,\"updateDay\":18916},\"activeGMPlugins\":{\"gmp-gmpopenh264\":{\"version\":null,\"userDisabled\":false,\"applyBackgroundUpdates\":1}}}}}"
[task 2021-10-16T19:34:35.708Z] 19:34:35     INFO -  HTTPException in handler: 500
[task 2021-10-16T19:34:35.712Z] 19:34:35     INFO -  Traceback (most recent call last):
[task 2021-10-16T19:34:35.712Z] 19:34:35     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.6/site-packages/wptserve/handlers.py", line 359, in __call__
[task 2021-10-16T19:34:35.712Z] 19:34:35     INFO -      rv = self.func(request, response)
[task 2021-10-16T19:34:35.712Z] 19:34:35     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.6/site-packages/telemetry_harness/ping_server.py", line 36, in pings_handler
[task 2021-10-16T19:34:35.712Z] 19:34:35     INFO -      ping_data = json.loads(request_data)
[task 2021-10-16T19:34:35.712Z] 19:34:35     INFO -    File "/usr/lib/python3.6/json/__init__.py", line 354, in loads
[task 2021-10-16T19:34:35.712Z] 19:34:35     INFO -      return _default_decoder.decode(s)
[task 2021-10-16T19:34:35.712Z] 19:34:35     INFO -    File "/usr/lib/python3.6/json/decoder.py", line 339, in decode
[task 2021-10-16T19:34:35.712Z] 19:34:35     INFO -      obj, end = self.raw_decode(s, idx=_w(s, 0).end())
[task 2021-10-16T19:34:35.712Z] 19:34:35     INFO -    File "/usr/lib/python3.6/json/decoder.py", line 355, in raw_decode
[task 2021-10-16T19:34:35.712Z] 19:34:35     INFO -      obj, end = self.scan_once(s, idx)
[task 2021-10-16T19:34:35.713Z] 19:34:35     INFO -  json.decoder.JSONDecodeError: Invalid control character at: line 1 column 7565 (char 7564)
[task 2021-10-16T19:34:35.721Z] 19:34:35     INFO -  During handling of the above exception, another exception occurred:
[task 2021-10-16T19:34:35.721Z] 19:34:35     INFO -  Traceback (most recent call last):
[task 2021-10-16T19:34:35.722Z] 19:34:35     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.6/site-packages/wptserve/server.py", line 286, in finish_handling
[task 2021-10-16T19:34:35.724Z] 19:34:35     INFO -      handler(request, response)
[task 2021-10-16T19:34:35.724Z] 19:34:35     INFO -    File "/builds/worker/workspace/build/venv/lib/python3.6/site-packages/wptserve/handlers.py", line 364, in __call__
[task 2021-10-16T19:34:35.725Z] 19:34:35     INFO -      raise HTTPException(500, message=msg)
[task 2021-10-16T19:34:35.725Z] 19:34:35     INFO -  wptserve.utils.HTTPException: 500

Set release status flags based on info from the regressing bug 1734262

So I think what's going on here is that the test harness is trying to decode the JSON payload being spit out from console.log. We're removing that spew in bug 1736431.

(In reply to Bobby Holley (:bholley) from comment #2)

We're removing that spew in bug 1736431.

Sorry, I meant bug 1736623, which has now landed. Does this appear to be fixed?

The issue persists.

Looks like the permafail was sorted out by way of reverting back to pingsender1?

Preserving the NI on myself for when I get back to relanding pingsender2.

I filed bug 1746983 to track the reenabling.